Convergence rate of Bayesian supervised tensor modeling with multiway shrinkage priors
نویسنده
چکیده
This article studies the convergence rate of the posterior for Bayesian low rank supervised tensor modeling with multiway shrinkage priors. Multiway shrinkage priors constitute a new class of shrinkage prior distributions for tensor parameters in Bayesian low rank supervised tensor modeling to regress a scalar response on a tensor predictor with the primary aim to identify cells in the tensor predictor which are predictive of the scalar response. This novel and computationally efficient framework stems from pressing needs in many applications, including functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI). This article shows that the convergence rate is nearly optimal in terms of in-sample predictive accuracy of the Bayesian supervised low rank tensor model with a multiway shrinkage prior distribution when the number of observations grows. The conditions under which this nearly optimal convergence rate is achieved are seen to be very mild. More importantly, the rate is achieved for an easily computable method, even when the true CP/PARAFAC rank of the tensor coefficient corresponding to the tensor predictor is unknown.
منابع مشابه
Bayesian Tensor Regression
We propose a Bayesian approach to regression with a scalar response on vector and tensor covariates. Vectorization of the tensor prior to analysis fails to exploit the structure, often leading to poor estimation and predictive performance. We introduce a novel class of multiway shrinkage priors for tensor coefficients in the regression setting and present posterior consistency results under mil...
متن کاملPosterior Contraction in Sparse Bayesian Factor Models for Massive Covariance
Sparse Bayesian factor models are routinely implemented for parsimonious dependence modeling and dimensionality reduction in highdimensional applications. We provide theoretical understanding of such Bayesian procedures in terms of posterior convergence rates in inferring high-dimensional covariance matrices where the dimension can be potentially larger than the sample size. Under relevant spar...
متن کاملScalable Bayesian Low-Rank Decomposition of Incomplete Multiway Tensors
We present a scalable Bayesian framework for low-rank decomposition of multiway tensor data with missing observations. The key issue of pre-specifying the rank of the decomposition is sidestepped in a principled manner using a multiplicative gamma process prior. Both continuous and binary data can be analyzed under the framework, in a coherent way using fully conjugate Bayesian analysis. In par...
متن کاملEnsemble Learning for Cross-Selling Using Multitype Multiway Data Ensemble Learning for Cross-Selling Using Multitype Multiway Data
Cross-selling is an integral component of customer relationship management. Using relevant information to improve customer response rate is a challenging task in cross-selling. Incorporating multitype multiway customer behavioral, including related product, similar customer and historical promotion, data into cross-selling models is helpful in improving the classification performance. Customer ...
متن کاملBayesian Sparse Tucker Models for Dimension Reduction and Tensor Completion
Tucker decomposition is the cornerstone of modern machine learning on tensorial data analysis, which have attracted considerable attention for multiway feature extraction, compressive sensing, and tensor completion. The most challenging problem is related to determination of model complexity (i.e., multilinear rank), especially when noise and missing data are present. In addition, existing meth...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- J. Multivariate Analysis
دوره 160 شماره
صفحات -
تاریخ انتشار 2017